Learning Audio-Sheet Music Correspondences for Score Identification and Offline Alignment
نویسندگان
چکیده
This work addresses the problem of matching short excerpts of audio with their respective counterparts in sheet music images. We show how to employ neural networkbased cross-modality embedding spaces for solving the following two sheet music-related tasks: retrieving the correct piece of sheet music from a database when given a music audio as a search query; and aligning an audio recording of a piece with the corresponding images of sheet music. We demonstrate the feasibility of this in experiments on classical piano music by five different composers (Bach, Haydn, Mozart, Beethoven and Chopin), and additionally provide a discussion on why we expect multi-modal neural networks to be a fruitful paradigm for dealing with sheet music and audio at the same time.
منابع مشابه
Improvement of an Online Music Alignment Based on Onset Information
Music alignment is the association of events in a musical score with points in the time frames of an audio signal. So it is also called audio-score alignment. Until now, most polyphonic audio-score alignment methods are offline algorithms, and alignment accuracy drops significantly when using online algorithms. But most applications based on alignment need real-time results, such as Automatical...
متن کاملAligning Semi-Improvised Music Audio with Its Lead Sheet
Existing audio-score alignment methods assume that the audio performance is faithful to a fully-notated MIDI score. For semi-improvised music (e.g. jazz), this assumption is strongly violated. In this paper, we address the problem of aligning semi-improvised music audio with a lead sheet. Our approach does not require prior training on performances of the lead sheet to be aligned. We start by a...
متن کاملScore Informed Tonic Identification for Makam Music of Turkey
Tonic is a fundamental concept in many music traditions and its automatic identification should be relevant for establishing the reference pitch when we analyse the melodic content of the music. In this paper, we present two methodologies for the identification of the tonic in audio recordings of makam music of Turkey, both taking advantage of some score information. First, we compute a promine...
متن کاملAn Approach for Linking Score and Audio Recordings in Makam Music of Turkey
The main information sources to study a particular piece of music are symbolic scores and audio recordings. These are complementary representations of the piece and it is very useful to have a proper linking between the two of the musically meaningful events. For the case of makam music of Turkey, linking the available scores with the corresponding audio recordings requires taking the specifici...
متن کاملTraining Ircam’s Score Follower
This paper describes our attempt to make the Hidden Markov Model (HMM) score following system developed at Ircam sensible to past experiences in order to obtain better audio to score real-time alignment for musical applications. A new observation modeling based on Gaussian Mixture Models is developed which is trainable using a learning algorithm we would call automatic discriminative training. ...
متن کامل